X-ray vision aircraft landscape camera

ABSTRACT

A method for providing visual data of a landscape below an aircraft includes capturing visual data of a landscape below an aircraft, using a camera on the aircraft. The visual data is compared to previously captured visual data of the landscape. It is then determined which of the visual data and the previously captured visual data provides a clearer view of the landscape based upon the comparison. The one of the visual data and the previously captured visual data that is determined to provide the clearer view is then displayed to a user.

TECHNICAL FIELD

The present teachings relate to the field of aircraft landscape camerasand, more particularly, to systems and methods for providing a landscapeview to a user from the aircraft when a visual obstruction existsbetween the aircraft and the landscape.

BACKGROUND

Some aircrafts currently include a camera on the exterior of theaircraft that captures visual data (e.g., pictures, videos, or both) ofthe landscape below the aircraft. This visual data may be viewed bypassengers on the aircraft. For example, a passenger in an aisle seatmay be able to view a pod of whales swimming in the sea below theaircraft by viewing the visual data on a display in the headrest of theseat in front of the passenger.

Oftentimes, however, the landscape below the aircraft is obstructed byclouds or darkness. When this occurs, the passenger is unable to viewthe landscape below the aircraft. What is needed, therefore, is animproved system and method that allows the user to view the landscapebelow the aircraft even when the landscape is obstructed by clouds ordarkness.

SUMMARY

The following presents a simplified summary in order to provide a basicunderstanding of some aspects of the present teachings. This summary isnot an extensive overview, nor is it intended to identify key orcritical elements of the present teachings, nor to delineate the scopeof the disclosure. Rather, its primary purpose is merely to present oneor more concepts in simplified form as a prelude to the detaileddescription presented later.

A method for providing visual data of a landscape below an aircraft isdisclosed. The method includes capturing visual data of a landscapebelow an aircraft, using a camera on the aircraft. The visual data iscompared to previously captured visual data of the landscape. It is thendetermined which of the visual data and the previously captured visualdata provides a clearer view of the landscape based upon the comparison.The one of the visual data and the previously captured visual data thatis determined to provide the clearer view is then displayed to a user.

In another embodiment, the method includes capturing visual data of alandscape below an aircraft, using a camera on the aircraft. At least aportion of the landscape in the visual data is obscured. The visual datais compared to previously captured visual data of the landscape. It isdetermined that the previously captured visual data provides a clearerview of the landscape than the visual data based upon the comparison.The previously captured visual data is then displayed to a user.

A system for providing visual data of a landscape below an aircraft isalso disclosed. The system includes a camera configured to be coupled toan aircraft. The camera is configured to capture visual data of alandscape below the aircraft. A computer system is configured to receivethe visual data from the camera. The computer system is configured tocompare the visual data to previously captured visual data of thelandscape. The computer system is also configured to determine that thepreviously captured visual data provides a clearer view of the landscapethan the visual data based upon the comparison.

The features, functions, and advantages that have been discussed can beachieved independently in various implementations or may be combined inyet other implementations further details of which can be seen withreference to the following description and drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of this specification, illustrate the present teachings andtogether with the description, serve to explain the principles of thedisclosure. In the figures:

FIG. 1 is a schematic side view of an aircraft in flight, with a visualobstruction positioned between the aircraft and the landscape below,according to an embodiment.

FIG. 2 is a flow chart of a method for providing visual data of thelandscape below the aircraft, according to an embodiment.

FIG. 3 is a schematic view of a system for providing visual data of thelandscape below the aircraft, according to an embodiment.

It should be noted that some details of the Figures have been simplifiedand are drawn to facilitate understanding of the present teachingsrather than to maintain strict structural accuracy, detail, and scale.

DETAILED DESCRIPTION

Reference will now be made in detail to examples of the presentteachings which are illustrated in the accompanying drawings. Whereverpossible, the same reference numbers will be used throughout thedrawings to refer to the same or like parts.

FIG. 1 is a schematic side view of an aircraft 100 in flight, with avisual obstruction 160 positioned between the aircraft 100 and thelandscape 150 below, according to an embodiment. As shown, the aircraft100 is an airplane; however, in other embodiments, the aircraft 100 maybe a helicopter, an unmanned aerial vehicle (“UAV”), a satellite, or thelike. The aircraft 100 may include a body 110 having a first (e.g.,front) end 112 and a second (e.g., rear) end 114. A cockpit may bepositioned proximate to the first end 112. The second end 114 mayinclude a tail 116 having a horizontal stabilizer 117 and a verticalstabilizer 118. The body 110 may also include one or more wings 120 thatextend laterally therefrom.

One or more cameras (four are shown: 130, 132, 134, 136) may be coupledto and/or positioned on the exterior of the body 110. As shown, thefirst camera 130 may be positioned proximate to the first end 112 of thebody 110. The first camera 130 may have a field of view 131 thatincludes directly in front of the aircraft 100 (e.g., aligned with acentral longitudinal axis through the body 110), directly below theaircraft 100 (e.g., perpendicular with the central longitudinal axisthrough the body 110), slightly behind the aircraft 100, laterally tothe sides of the aircraft 100, or a combination thereof.

The second camera 132 may be positioned proximate to the second end 114of the body 110. More particularly, the second camera 132 may be coupledto the tail 116 (e.g., the vertical stabilizer 118). The second camera132 may have a field of view 133 that includes directly in front of theaircraft 100, the upper surface of the aircraft 100, below the aircraft100, laterally to the sides of the aircraft 100, or a combinationthereof.

The third camera 134 may also be positioned proximate to the second end114 of the body 110. More particularly, the third camera 134 may becoupled to the body 110 below the tail 116. The third camera 134 mayhave a field of view 135 that includes directly below the aircraft 100,laterally to the sides of the aircraft 100, behind the aircraft 100, ora combination thereof.

The fourth camera 136 may be positioned on an upper surface of the body110. The fourth camera 136 may have a field of view 137 that includesabove the aircraft 100. Although only four cameras 130, 132, 134, 136are shown, it will be appreciated that more or fewer cameras may beused. For example, additional cameras may be added that includedifferent fields of view than those shown in FIG. 1.

When the aircraft 100 is in flight, the aircraft 100 may be from about20 meters to about 20 kilometers (or more) above the landscape 150. Thelandscape 150 may include land (e.g., cities, military bases, plains,forests, mountains, etc.) or water (e.g., lakes, rivers, oceans, etc.).The cameras 130, 132, 134 may be configured to capture visual data(e.g., pictures, video, or both) of the landscape 150 while the aircraft100 is in flight. In another embodiment, the camera 136 may beconfigured to capture visual data of the sky 156 while the aircraft 100is in flight. The visual data may then be provided to a user (e.g., apassenger on the aircraft 100) so that the user may view the landscape150.

Sometimes, however, a visual obstruction 160 may prevent the cameras130, 132, 134 from capturing clear visual data of the landscape 150. Forexample, the aircraft 100 may be flying at night, and the visualobstruction 160 may be darkness that prevents the cameras 130, 132, 134from capturing clear visual data of the landscape 150. In anotherexample, the visual obstruction 160 may be clouds, fog, or hazepositioned between the aircraft 100 and the landscape 150.

FIG. 2 is a flow chart of a method 200 for providing visual data of thelandscape 150 below the aircraft 100 (e.g., when the landscape 150 isobscured by a visual obstruction 160). Although method 200 refers to thelandscape 150 below the aircraft 100, it will be appreciated that themethod 200 may also be used to capture visual data of the sky 156 abovethe aircraft 100 to allow the user to view stars, planets, satellites,etc. (e.g., using the fourth camera 136).

The method 200 may include capturing visual data of a landscape 150below an aircraft 100 (or a sky 156 above the aircraft 100), using acamera 130, 132, 134 on the aircraft 100, while the aircraft 100 is inflight, as at 202. The method 200 may also include determining alocation of the aircraft 100 at a time when the visual data is captured,as at 204. The location of the aircraft 100 may include the latitude,the longitude, the altitude, or a combination thereof. The location ofthe aircraft 100 may be determined by a global positioning system(“GPS”), an altimeter, or a combination thereof aboard the aircraft 100.The method 200 may also include determining an orientation of theaircraft 100 at the time when the visual data is captured, as at 206.The orientation of the aircraft 100 may include the pitch, the yaw, theroll, or a combination thereof.

The method 200 may also include storing the visual data, the location ofthe aircraft 100, the orientation of the aircraft 100, or a combinationthereof in a storage device, as at 208. The method 200 may also includecomparing (e.g., using a computer system) the visual data of thelandscape to previously captured visual data of the landscape, as at210. The previously captured visual data may have been captured by thesame aircraft 100 (e.g., on an earlier flight) or by a differentaircraft. The previously captured visual data may also be stored in thestorage device.

The previously captured visual data may have been captured from asimilar location as the visual data. As used herein, the visual data andthe previously captured visual data are captured from “a similarlocation” when the latitudes of the visual data and the previouslycaptured visual data are within 1 kilometer of one another, thelongitudes of the visual data and the previously captured visual dataare within 1 kilometer of one another, and the altitudes of the visualdata and the previously captured visual data are within 1 kilometer ofone another.

The previously captured visual data may have been captured from anaircraft having a similar orientation as the aircraft 100 that capturedthe visual data. As used herein, the visual data and the previouslycaptured visual data are captured from “a similar orientation” when thepitch of the visual data and the previously captured visual data arewithin 10 degrees of one another, the yaw of the visual data and thepreviously captured visual data are within 10 degrees of one another,and the roll of the visual data and the previously captured visual dataare within 10 degrees of one another.

The method 200 may also include determining which of the visual data(captured at 202) and the previously captured visual data provides aclearer view of the landscape 150 based upon the comparison, as at 212.The one of the visual data (captured at 202) and the previously capturedvisual data that provides the clearer view may be the one including morelight (e.g., sunlight or moonlight), fewer clouds, less fog or haze,higher resolution, or a combination thereof. For example, if thepreviously captured visual data is captured during the daytime and thevisual data (captured at 202) is captured at night, the previouslycaptured visual data may be determined to provide the clearer viewbecause darkness may obscure the view of the landscape 150 in the visualdata captured at night. In another example, if a visual obstruction(e.g., clouds, fog, haze, etc.) 160 at least partially obstructs theview of the landscape 150 in the previously captured visual data, and nosuch visual obstruction 160 (or a lesser visual obstruction 160) ispresent in the visual data (captured at 202), the visual data (capturedat 202) may be determined to provide the clearer view because theclouds, fog, haze, etc. may obscure the view of the landscape 150 in thepreviously captured visual data. In yet another example, if both thevisual data (captured at 202) and the previously captured visual datainclude similar lighting and similar visual obstructions 160, the onehaving the higher resolution may be determined to provide the clearerview because more details of the landscape 150 may be seen. In yetanother example, if both the visual data (captured at 202) and thepreviously captured visual data are determined to have substantiallyequal clarity, then the visual data (captured at 202) may be provided tothe user because it is more recent (e.g., real-time).

The method 200 may also include identifying one or more landmarks (twoare shown: 152, 154) that are found in the visual data (captured at 202)and in the previously captured visual data, as at 214. The landmarks152, 154 may be or include recognizable features in the landscape 150.As shown, the landmarks include a building 152 and a mountain 154;however, as will be appreciated, many other types of landmarks are alsocontemplated herein. The landmarks 152, 154 in the visual data (capturedat 202) and in the previously captured visual data may be compared withone another to confirm that the locations and/or orientations of thevisual data (captured at 202) and the previously captured visual dataare similar, as discussed above. In addition, in some embodiments,determining which of the visual data (captured at 202) and thepreviously captured visual data provides a clearer view of the landscape150 may include performing object recognition on the landmarks 152, 154and determining which of the visual data (captured at 202) and thepreviously captured visual data provides a clearer view of the landmarks152, 154.

The method 200 may also include displaying the one of the visual data(captured at 202) and the previously captured visual data that isdetermined to provide the clearer view to a user, as at 216. In anotherembodiment, the user may select (e.g., switch between) the view of thevisual data (captured at 202) and the previously captured visual data.The user may also select (e.g., switch between) the views from thedifferent cameras 130, 132, 134 to provide different viewing angles ofthe landscape 150. The user may also select between different algorithmsto accommodate the user's viewing preferences.

The user may be a passenger on the aircraft 100. In one embodiment, theone of the visual data (captured at 202) and the previously capturedvisual data that is determined to provide the clearer view may bedisplayed on a screen that is part of the aircraft 100. For example, thescreen may be in the back of the headrest of the seat in front of thepassenger, in the tray table, in a virtual window or shade, or the like.In another embodiment, the one of the visual data (captured at 202) andthe previously captured visual data that is determined to provide theclearer view may be transmitted wirelessly to the passenger's mobiledevice (e.g., smart phone, tablet, laptop, smart watch, wireless camera,etc.) where it may be displayed. In another embodiment, the user may notbe aboard the aircraft 100, as discussed in greater detail below. In yetanother embodiment, the visual data may be of the sky 156 and capturedby the camera 136. The visual data may then be displayed on one or morepanels on the ceiling of the aircraft 100 (e.g., above the passengers).The panels may be, for example, LED panels that are configured to showthe current location of the stars, planets, satellites, etc. in the sky156.

The method 200 may also include transmitting, in response to a commandby the user, at least a portion of the one of the visual data (capturedat 202) and the previously captured visual data that is determined toprovide the clearer view, as at 218. The portion of the one of thevisual data (captured at 202) and the previously captured visual datathat is determined to provide the clearer view may be transmitted viatext message, email, or posted to a social media site. The transmissionmay occur while the aircraft 100 is still in flight, or the transmissionmay be delayed until the aircraft 100 has landed (e.g., when theaircraft 100 is at the terminal). In at least one embodiment, theportion of the one of the visual data (captured at 202) and thepreviously captured visual data that is determined to provide theclearer view may be transmitted to a third party for a fee where thethird party may use the visual data to update a database.

FIG. 3 is a schematic view of a system 300 for providing visual data ofthe landscape 150 below the aircraft 100 (e.g., when the landscape 150is obscured by a visual obstruction 160). The system 300 may include oneor more of the cameras 130, 132, 134 discussed above. The system 300 mayalso include a computer system 310. At least a portion of the computersystem 310 may be aboard the aircraft 100. The computer system 310 mayinclude a processor 312, a storage media 314, and a transmitter 316. Thevisual data (and the location information, orientation information,etc.) may be received by computer system 310 and stored in the storagemedia 314. As mentioned above, previously captured visual data may alsobe stored in the storage media 314.

The computer system 310 may be configured to run a software application(e.g., an algorithm) to compare the visual data and the previouslycaptured visual data and/or determine which provides a clearer view ofthe landscape 150. For example, the computer system 310 may includeobject recognition software that is configured to compare the visualdata and the previously captured visual data and determine whichprovides a clearer view of the landscape 150.

In at least one embodiment, the system 300 may include a display 320aboard the aircraft 100. For example, the display 320 may be in the backof the headrest of one of the seats, or the display 320 may be hangingdown from the ceiling of the aircraft 100 (e.g., above the aisle). Thecomputer system 310 may transmit the one of the visual data and thepreviously captured visual data that is determined to provide theclearer view to the display 320 for the user to see. In anotherembodiment, the transmitter 316 of the computer system 310 may (e.g.,wirelessly) transmit the one of the visual data and the previouslycaptured visual data that is determined to provide the clearer view to amobile device 330 owned by the user.

The system 300 may also include a broadband satellite system 340. Thebroadband satellite system 340 may be positioned aboard the aircraft 100or positioned at a ground location (i.e., offboard). When the broadbandsatellite system 340 is offboard, the broadband satellite system 340 maybe configured to receive the one of the visual data and the previouslycaptured visual data that is determined to provide the clearer view fromthe computer system 310 either wirelessly (e.g., while the aircraft 100is in flight) or via a wired connection after the aircraft 100 haslanded. The broadband satellite system 340 may be configured to transmitthe one of the visual data and the previously captured visual data thatis determined to provide the clearer view to a satellite 350, which mayrelay the signal to a ground station 360. The ground station 360 maythen transmit the one of the visual data and the previously capturedvisual data that is determined to provide the clearer view to, forexample, a cloud server 370 on the Internet. The one of the visual dataand the previously captured visual data that is determined to providethe clearer view may then be transmitted from the cloud server 370 to,for example, a social media server 380.

Notwithstanding that the numerical ranges and parameters setting forththe broad scope of the present teachings are approximations, thenumerical values set forth in the specific examples are reported asprecisely as possible. Any numerical value, however, inherently containscertain errors necessarily resulting from the standard deviation foundin their respective testing measurements. Moreover, all ranges disclosedherein are to be understood to encompass any and all sub-ranges subsumedtherein. For example, a range of “less than 10” can include any and allsub-ranges between (and including) the minimum value of zero and themaximum value of 10, that is, any and all sub-ranges having a minimumvalue of equal to or greater than zero and a maximum value of equal toor less than 10, e.g., 1 to 5. In certain cases, the numerical values asstated for the parameter can take on negative values. In this case, theexample value of range stated as “less than 10” can assume negativevalues, e.g. −1, −2, −3, −10, −20, −30, etc.

While the present teachings have been illustrated with respect to one ormore implementations, alterations and/or modifications can be made tothe illustrated examples without departing from the spirit and scope ofthe appended claims. It will be appreciated that structural componentsand/or processing stages can be added or existing structural componentsand/or processing stages can be removed or modified. Furthermore, to theextent that the terms “including,” “includes,” “having,” “has,” “with,”or variants thereof are used in either the detailed description and theclaims, such terms are intended to be inclusive in a manner similar tothe term “comprising.” The term “at least one of” is used to mean one ormore of the listed items can be selected. Further, in the discussion andclaims herein, the term “on” used with respect to two materials, one“on” the other, means at least some contact between the materials, while“over” means the materials are in proximity, but possibly with one ormore additional intervening materials such that contact is possible butnot required. Neither “on” nor “over” implies any directionality as usedherein. The term “about” indicates that the value listed may be somewhataltered, as long as the alteration does not result in nonconformance ofthe process or structure to the present teachings. Finally, “exemplary”indicates the description is used as an example, rather than implyingthat it is an ideal. The present disclosure provides specificimplementations without being exhaustive, and other implementations ofthe present teachings may be apparent to those skilled in the art fromconsideration of the specification and practice of the disclosureherein. It is intended that the specification and examples be consideredas exemplary only, with a true scope and spirit of the present teachingsbeing indicated by the following claims.

1. A method for providing visual data of a landscape below an aircraft,comprising: capturing visual data of a landscape below an aircraft,using a camera on the aircraft; comparing the visual data to previouslycaptured visual data of the landscape; determining which of the visualdata and the previously captured visual data provides a clearer view ofthe landscape based upon the comparison; and displaying the one of thevisual data and the previously captured visual data that is determinedto provide the clearer view to a user.
 2. The method of claim 1, whereinthe previously captured visual data was captured by the same aircraft onan earlier flight.
 3. The method of claim 1, wherein the previouslycaptured visual data was captured by a different aircraft.
 4. The methodof claim 1, further comprising determining a location of the aircraft ata time when the visual data is captured, wherein the location of theaircraft comprises a latitude of the aircraft, a longitude of theaircraft, an altitude of the aircraft, or a combination thereof, andwherein the latitude, the longitude, the altitude, or the combinationthereof is within 1 kilometer of a location where the previouslycaptured visual data was captured.
 5. The method of claim 1, furthercomprising determining an orientation of the aircraft at a time when thevisual data is captured, wherein the orientation of the aircraftcomprises a pitch of the aircraft, a yaw of the aircraft, a roll of theaircraft, or a combination thereof, and wherein the pitch, the yaw, theroll, or the combination thereof is within 10 degrees of a pitch, a yaw,a roll, or a combination thereof of the previously captured visual data.6. The method of claim 1, further comprising transmitting, in responseto a command by the user, at least a portion of the one of the visualdata and the previously captured visual data that is determined toprovide the clearer view.
 7. The method of claim 1, further comprisingidentifying one or more landmarks that are found in the visual data andin the previously captured visual data.
 8. The method of claim 1,wherein the one of the visual data and the previously captured visualdata that is determined to provide the clearer view includes moresunlight.
 9. The method of claim 1, wherein the one of the visual dataand the previously captured visual data that is determined to providethe clearer view includes fewer clouds, less fog, or less haze.
 10. Themethod of claim 1, wherein the one of the visual data and the previouslycaptured visual data that is determined to provide the clearer viewincludes a higher resolution.
 11. A method for providing visual data ofa landscape below an aircraft, comprising: capturing visual data of alandscape below an aircraft, using a camera on the aircraft, wherein atleast a portion of the landscape in the visual data is obscured;comparing the visual data to previously captured visual data of thelandscape; determining that the previously captured visual data providesa clearer view of the landscape than the visual data based upon thecomparison; and displaying the previously captured visual data a user.12. The method of claim 11, wherein the portion of the landscape in thevisual data is obscured by a cloud, a haze, fog, darkness, or acombination thereof.
 13. The method of claim 12, further comprising:determining a location of the aircraft at a time when the visual data iscaptured, wherein the location is within 1 kilometer of a location wherethe previously captured visual data was captured; and determining anorientation of the aircraft at the time when the visual data iscaptured, wherein the orientation is within 10 degrees of an orientationof the previously captured visual data.
 14. The method of claim 12,wherein the previously captured visual data is determined to provide theclearer view because the previously captured visual data includes moresunlight, fewer clouds, less haze, less fog, or higher resolution thanthe visual data.
 15. The method of claim 12, further comprisingidentifying one or more landmarks that are found in the visual data andin the previously captured visual data, wherein determining that thepreviously captured visual data provides a clearer view of the landscapethan the visual data comprises determining that the previously capturedvisual data provides a clearer view of the one or more landmarks thanthe visual data.
 16. A system for providing visual data of a landscapebelow an aircraft, comprising: a camera configured to be coupled to anaircraft, wherein the camera is configured to capture visual data of alandscape below the aircraft; and a computer system configured toreceive the visual data from the camera, wherein the computer system isconfigured to: compare the visual data to previously captured visualdata of the landscape; and determine that the previously captured visualdata provides a clearer view of the landscape than the visual data basedupon the comparison.
 17. The system of claim 16, further comprising adisplay configured to receive the previously captured visual data fromthe computer system.
 18. The system of claim 17, wherein the display ispart of the aircraft.
 19. The system of claim 17, where in the displayis a mobile device belonging to a user aboard the aircraft.
 20. Thesystem of claim 16, further comprising a broadband satellite systemconfigured to receive the previously captured visual data from thecomputer system and to transmit the previously captured visual data to aserver via a satellite.